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Abstract. We determine the graded composition multiplicity in the symmetric algebra 
S'(V) of the natural GL n (q)-module V , or equivalently in the coinvariant algebra of V, 
for a large class of irreducible modules around the Steinberg module. This was built on 
a computation, via connections to algebraic groups, of the Steinberg module multiplicity 
in a tensor product of S'(V) with other tensor spaces of fundamental weight modules. 



1. Introduction 

The symmetric algebra S'(V) is naturally a graded module over the finite general linear 
group GL n (q), where V = ¥ n is the standard GL n (g)-module over an algebraically closed 
field F of characteristic p and q = p r for r > 1. Dickson's classical theorem |Dij states that 
the algebra of GL n (g)-invariants in S*(V) is a polynomial algebra in n generators, and 
this work served as the starting point of all the subsequent works on the GL n (q)-module 
structure of S'(V) and closely related modules. 

The composition multiplicity of the Steinberg module St in S'(V) <S> /\*(V) (8> Det fc , 
where A*(V) denotes the exterior algebra of V and Det denotes the determinant module, 
has been determined in various special cases by Kuhn, Mitchell, and Priddy \KM.\ [Mi\ 
IMPj and in full generality by the authors [WW| . The topological approach of \Mi\ IMP] 
using Steenrod algebra worked only in a prime field and it is not clear how to develop 
further along this line. On the other hand, the approach of [KM[ IWWj is based on 
a modular version of a formula of Curtis in terms of parabolic subgroup invariants (for 
closely related work see |MuillMT] ). These parabolic subgroup invariants were determined 
in a constructive manner, and it seems difficult to extend the approach much further. 

By a basic observation of Mitchell [Mij . finding the graded multiplicity of a simple 
module L in the symmetric algebra S*(V) is equivalent to finding the graded composition 
multiplicity of L in the coinvariant algebra of V which is a graded regular representation 
of GL n (q). A full answer for every simple GL n (g)-module is beyond the reach for now as 
it would imply the degrees of all principal indecomposable modules (PIMs). 

The main goal of the paper is to find an elegant closed formula for the graded composi- 
tion multiplicity in S'(V) for a large class of simple GL n (g)-modules around the Steinberg 
module (i.e., simple modules of highest weights not far from the Steinberg weight (q—l)p). 
The twisting by the determinant module plays an important role in this paper. 

Our new approach is based on the intimate and deep connections between representa- 
tions of GL n {q) and of the algebraic group GL n (¥), and it is a two-step process. First, 
via connections to algebraic groups, we compute the graded composition multiplicity of 
St in various tensor modules of the form S'(V) (g) N for some natural GL n (F)-modules 
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N. Secondly, such a composition multiplicity of St when combined with classical results 
on PIMs of GL n {q) are used to derive a closed formula for the graded composition multi- 
plicity in S'iV) for a large class of simple GL n (g)-modules around the Steinberg module 
(up to twists by Det). 

Let us explain in some detail. Bendel, Nakano and Pillen |BNPj has recently developed 
an amazing link between the Ext-groups of GL n {q) and of GL n (¥), and used it to find 
upper bounds for cohomology of finite groups. As explained to us by Pillen (see Section[2]), 
the machinery of |BNP] can be used effectively to transform the problem of computing the 
Steinberg module multiplicity in a rational GL n (F)-module with a good filtration (viewed 
as a GL n (g)-module) into a problem of counting multiplicities in infinitely many rational 
GL n (F)-modules with good nitrations. By a classical result of J. -P. Wang jWaj . the latter 
becomes essentially a highly nontrivial combinatorial problem of counting multiplicities 
of irreducible characters in characteristic zero. In our cases of interest, the intricate 
combinatorial problem can be eventually solved with a key tool being the Pieri formula. 
In this way, we are able to determine the graded multiplicity of the Steinberg module in 
S'(V) ® A m (V) <g) Det fc (see Theorem EE]) and more generally in S'(V) <g> A"(V) ® Det fc 
for suitable partitions v and suitable k (see Theorem I3.4p . Theorem 13.11 recovers in a 
different form one of the main results in [WW , Theorem C] . 

Note that Hom GLri ( g) (St, S'(V) ® N) = Hom GLn(9) (St <g> N*, S'(V)) for a finite dimen- 
sional GL n (g)-module N, and that St <g> N* is projective. The results of Ballard on PIMs 
[Ba (which was inspired by Humphreys and Verma |HV] and improved by Chastkofsky 
|Chj and Jantzen |J1] ) allow us to find an explicit decomposition of St ® N* for suitable 
TV into a direct sum of PIMs. We derive from this and Theorem 13.41 a closed formula for 
the graded composition multiplicity in S'(V) for a large class of simple modules around 
the Steinberg module; see Theorem 14.71 In light of an observation in |Mi] . Theorem 14.71 
affords an equivalent reformulation in terms of the coinvariant algebra of V in place of 
S'(V); see Theorem 14. 101 Also, from Theorem 13. II and results of Tsushima |Tsj on PIMs 
(a special case of which goes back to Lusztig [Lu| ). we recover the main results of Carlisle 
and Walker jCW| . who obtained a multiplicity formula for several simple modules very 
close to St in S'(V) using an ingenious combinatorial and semigroup approach. 

Our work opens a new and effective way of studying the GL n (q)-module structure of 
S*(V) via its connection to algebraic groups. At the end of the paper, we formulate 
several open problems, and speculate a formula on the composition multiplicity in the 
socle of S'(V) for a family of simple modules. 

The paper is organized as follows. In Section [2] we recall the basics of the algebraic 
group GL n {¥) and of the finite group GL n (q) (a basic reference in this direction is the 
book of Humphreys |Hu| ). and formulate a key formula derived from |BNPj . We determine 
the graded multiplicity of St in the tensor products of S'(V) with various natural GL n (q)- 
modules in Section [3j This is then applied in Section [J] to determine an explicit formula for 
the graded composition multiplicity in S'(V), or equivalently in the coinvariant algebra 
of V, for a large class of simple GL n (g)-modules. 

Acknowledgments. We are indebted to Cornelius Pillen for explaining to us a key 
consequence of results in |BNPj which has played a fundamental role in our work. In 
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2. The preliminaries 

2.1. Finite group GL n (q) and algebraic group GL n (¥). Let GL n (¥) be the general 
linear group over an algebraically closed field F of prime characteristic p > 0. Let T be the 
maximal torus consisting of diagonal matrices in GL n (¥) and B be the Borel subgroup 
consisting of upper triangular matrices. Denote by <3? + (resp. <3? - ) the corresponding 
positive (resp. negative) root system. Then we have the Weyl group W = S n , the set of 
simple roots II = . . . ,a n _i} and the normalized bilinear form satisfying (a, a) = 2 
for a G <£. The simple coroot a( = coincides with ai for 1 < i < n — 1. Let 

X = X{T) be the integral weight lattice which can be identified with Z n and denote the 
set of dominant integral weights by 

X+ = {A | A = (Ai, . . . , A n ) G Z n , Ai > A 2 > • • • > A n }. 

For A £ X + , there exists a simple GL n (F)-module L(\) of highest weight A. These 
GL n (F)-modules are pairwise non-isomorphic and exhaust the isomorphism classes of 
simple GL n (F)-modules. For A G X + , let V(A) := ind^j F ^A be the induced module 
and A(A) := V(— wqX)* be the Weyl module of highest weight A, where wo is the longest 
element in W. It is known that V(A) has a unique simple submodule isomorphic to L(X) 
and A(A) has a unique simple quotient isomorphic to L(X). 

Let Fr : GL n (¥) — > GL n (¥) denote the Frobenius map, and let q = p r for r > 1. 
The fixed point subgroup of the rth iterate of the Frobenius map can be identified with 
GL n (q). Denote the set of g-restricted weights in X + by 

X r = {A G X + | < A n < q, (A, cl{) < q, 1 < i < n - 1}. 

The restrictions to GL n (q) of the simple GL n (F)-modules L(X) with A G X r form a 
complete set of pairwise non-isomorphic simple GL n (g)-module (cf. |Huj . [J2J II.3]). In 
particular, the restriction of L((q — l)p) to GL n (q) is called the Steinberg module and 
denoted by St = St r , where p = (n — 1, n — 2, . . . , 1, 0). We shall also write 

(2.1) pi = n — i, i = l,...,n. 

Recall that a GL n (F)-module N has a good filtration (also called a V-filtration) if 
it admits a filtration with successive quotients of the form V(A), A G X + |J2[ II 4.16]. 
Denote by [N : V(A)] the multiplicity of V(A) appearing in a good filtration of N. We 
have the following lemma (cf. \J2\ II, Proposition 4.16]). 

Lemma 2.1. Let N be a GL n (¥) -module admitting a good filtration. Then, for each 
A G X + , 

[N : V(A)] = dim Hom GLn(F) (A(A), AO, 
Ext*(A(A), N) = 0, Vt>l. 

The following fundamental result is due to J. -P. Wang |Wa] (cf. |J2} II, Proposi- 
tion 4.19]). 
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Lemma 2.2. [Wa| If N and N' are GL n (¥) -modules admitting good titrations, then the 
tensor product N ® N' also has a good filtration. 

2.2. Relating GL n (q) to GL n (¥). Define the induced GL n (F)-module 

9 r (F)=indg^g(F). 

The basic properties of Sr(F) (for more general reductive groups) were described by Ben- 
del, Nakano and Pillen, and then used to give upper bounds on dimensions of cohomology 
of finite groups of Lie type. 

Lemma 2.3. |BNP} Proposition 2.3] Let M,N be rational GL n (¥) -modules. Then, 
Ext* GLn(g) (M, TV) Ext GMF) (M, AT® %(¥)), Vi > 0. 

Lemma 2.4. |BNP} Proposition 2.4] As a GL n (¥) -module, 3 r (F) has a filtration with 
factors V(A) ® V(— tOoA)^ r ' o/ multiplicity one for each A € -A" + . 

The proof of the following useful proposition, which follows from the above results of 
[BNP], was communicated to us by Cornelius Pillen. 

Proposition 2.5. Let N be a finite dimensional rational GL n (¥) -module admitting a 
good filtration. Then 

(2.2) dimHom Gin(9) (St,iV)= ^ [N ® V(A) : V((g — l)p + qX)]. 

A6X+ 

Proof. We first observe by Lemma |2~T1 and [J2j II, 3.19] that 
Ext GLn(F) (St, JV ® V(A) ® V(-«;oA) (r) ) 

- Ext GLn(F) (St ® A(A)W,iV ® V(A)) 

- Ext GLn(F) (A((g - l)p + gA), JV ® V(A)) 

Hom GLn(F) (A((g - l)p + gA),AT(g) V(A)), if t = 
0, if i > 0. 

It follows that Hom Giji (F)(St, A" ® V(A) ® V(— ifoA)^* 1 ) is nonzero only for finitely many 
A e X+. 

Let S be a GL n (g)-module which has a V(A) ® V(— wo A) ^-filtration. For a GL n (F)- 
submodule 5 of 3 having a V(A) ® V(— woA)( r )-filtration, we define a GL n (F)-module Q 
by the short exact sequence 

Then Q = S/M also has a V(A)®V(— it^ A) ^-filtration. The short exact sequence induces 
a long exact sequence with initial terms 

Hom GLn(F) (St, N ® S) — > Hom Gin(F) (St, N ® S) 

— ► Hom GLn(F) (St, N <S) Q) — ► Ext GMF) (Si, N ® S) 

where the last term Ext 1 vanishes by f|2.3[) . Hence we obtain the following identity: 
dimHom Gin(F) (St, N ® 3) = dimHom GLn(F) (St, iV ® 5) + dimHom GLn(F) (St, AT ® Q). 



(2.3) 
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By repeatedly applying this identity, we obtain that 

(2.4) dimHom Gin(F) (St,7V® 9 r (F)) = ^ dimHom(St, N <g> V(A) ® V(-u> A) (r) ) 

\ex+ 

where all but finitely many summands on the right-hand side are zero. 

By ([£3)1 . flUD , Lemma Lemma O and Lemma E3] (for M = St), we obtain that 

dimHom GLn((?) (St,AO = ^ dimHom(St, TV <8> V(A) ® V(-u; A) (r) ) 

AeA+ 

= ^ dimHom Gin(F) (A((g-l)p + gA),iV®V(A)) 
AeA+ 

= ^ [i\T®V(A): V((g-l)p + ?A)]. 
The proposition is proved. □ 

3. The Steinberg module multiplicity in a tensor product 

In this section, we will compute the multiplicity of the Steinberg module St of GL n (q) 
in S l, (F)(g>A' / (y)(g>Det fe and S' (V) <S> L{p) <g>Det fc , for < k < q-2 and certain partitions 
/x = (fii, . . . ,//„) of length < n. 

3.1. Some notations. We introduce the following notations: 

ei = (o,...,o,i,o,...,o) ex, 

u>m = (l m ) = (1, • • • , 1, 0, . . . , 0) G X+, l<m<n. 

For A G X + , set |A| = Yli^i- We denote by L(X)c the irreducible representation of 
highest weight A of the general linear Lie algebra gl n (C), and [M : L(A)c] the multiplicity 
of L(X)c in a semisimple g[ n (C)-module M. 

Let Z + denote the set of nonnegative integers. We denote by e^{x\, . . . ,x n ) the fe-th 
elementary symmetric polynomial for k G Z+, and denote by e v {x\, . . . ,x n ) the elemen- 
tary symmetric polynomial associated to a partition v whose first part v\ < n. For a 
partition /i, define the length £(/i) to be the number of nonzero parts in \i. We denote 
by m lJi (xi, . . . ,x n ) the monomial symmetric polynomial associated to a partition fj, with 
i(fj,) < n. Denote by fj/ the conjugate partition of fi. 

For a formal series f(t) G Z[[£]], denote by [t a ]f(t) the coefficient of t a in f(t) for 
a G Z+. 

Let Det denote the one-dimensional determinant GL n (g)-module. Note that Det = 
A n (V) = V(w„), and that Det 9 " 1 is the trivial module. 

For a graded vector space N* = @iN l , we define its Hilbert series to be 
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Recall the Steinberg module St of GL n (q) is absolutely irreducible and projective. For a 
graded GL n (q)-module N' = (BiN % , let us denote by 

H S t(N';t) = H(Rom GLn{q) (St,N-);t) = £ f dimHom GLn(g) (St, N*) 

i 

the graded multiplicity of St in N'. Similarly, we denote by Hst(N m ;t, s) (in two variables 
t and s) the graded multiplicity for St in a bi-graded GL n (g)-module N' = ©ijiV' J ', that 
is, 

H St (N';t,s) = ^f^dimHom GLn(9) (St,^'). 

3.2. The multiplicity of St in S*(V) <8> A m (F) <g> Det fc . We shall use the connection to 
the algebraic group GL n (¥) to determine the graded multiplicity of the Steinberg module 
St in S'{V) ® f\ (V) ® Det fc . 

Theorem 3.1. Suppose < m < n. 

(1) If l<k <q-2, then the graded multiplicity of St in 5*(V) <g> A m (V) <g> Det fe is 

H st {S'(V) ® A m (F) 55 Det fe ;t) = _ ^(r 1 ,^, . . . ,t^~ ). 

f£j TTje graded multiplicity of St in £*(V) ® A m (l^) is ^iueri fry 
H St (S'(V)® A m (V);t) 



Proo/. Let us fix a € Z+. Observe that 5 a (F) V(awi), and A m (y) ^ V(w m ). It follows 
by Lemma [231 that S a (V) ® A m (F) <g> Det fc has a good filtration. By Proposition [231 we 
turn the problem into a multiplicity problem in characteristic zero: 

dim Hom Gin(9) (St, S a {V) © f\ m {V) ® Det fc ) 
= ^ ^V(awi) V(w m ) (g) V(w„)® fc © V(A) : V((g-l)p + gA) 

(3.1) = ^ [L(awi) c ® L(u m )c L(oj n )® k ® L(A) C : L((q - l)p + gA) C ] • 
\ex+ 

By applying Pieri's formula twice (cf. |FH[ Proposition 15.25]), we deduce that 

L(awi)c ® i(%)c ® L(u n )c k ® L ( A )c 

— ©a I GZ + ,ai+---+a n =a,A i +fc+a l <A I _i+A.-^( <;J m)c ® £(Ai + & + Ol, . . . , A n + & + a n )c 

©L((Ai +k + a 1 ,...,X n + k + a n ) + £ il + --- + e im ) c , 
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where the summation is over the tuples (01, . . . , a n ) and . . . , i m ) satisfying (|3.2p - (l3,6D 
below: 

(3.2) 1 < i t < ■ ■ ■ < i m < n, 

(3.3) ai + ... + a n = a, 

(3.4) ai,...,a n G Z + , 

(3.5) Aj + A; + a; < Aj„i + A;, 

(3.6) A + A;w n + (ai,...,a n )+£i 1 -\ h e im G X + . 

Hence, the multiplicity [L(aoJi)c® i(w m )c® L{uj n )® k ® L(A)c : L((q — l)p+qX)c] is the 
same as the number of the tuples (cti, . . . ,a n ) and (ii, . . . , i m ) which satisfy (|3.2p ~ (|3,5D 
and the following additional equation 

(3.7) A + kuj n + (at, . . . , a n ) + + . . . + e im = (q - l)p + q\. 

Note that (|3.6p is implied by (|3.7p . Regarding (j3.7|) as a defining equation for (a±, . . . , a n ), 
we are reduced to counting the cardinality of the set which consists of the tuples 
(ii,...,i m ) satisfying (j3.2[) and the following additional conditions f)3.8|) - (|3. 12[) (recall 
from ()2.ip the notation pi): 



(3.8) 


(8- 


1) \p\ + (q — l)\X\ — nk — m = a, 


(3.9) 


(8- 


l )Pi + (q~ - fe > 0, for i / ii, . . .,i m , 


(3.10) 


(8- 


l )Pi + (Q ~ - - 1 > 0, for i = ii, . . . ,i m , 


(3.11) 


(8- 


l)pi + qXi < Ai_i + k, for i ^ i u . . . ,i m , 


(3.12) 


(8- 


I) Pi + q\i - 1 < Aj_i + fc, for i = i\, . . . , i m , 2 < i < n. 



Note here that ([33]) gives rise to (pTg]l . J33J) gives rise to (JHSJ) and (fBTTOl) . while (|53]) 
gives rise to (13. lip and (13. 12f) . Hence, we have 

E [L(aui) c <S> i(w m )c <8> £(A)c : £((8 - l)p + 8-%] 

AGX+ 

= E # r ™ 

AGX+ 

= #{(A,(ii,...,t m )) | A G X + , (ii, . . . ,i m ) G T™} 
(3.13) = E #{ A I A e X+ satisfies (|3T8]) - (l3Tl2D }. 

l<U<---<i m <n 

(1) Suppose 1 < k < q — 2. For fixed 1 < i\ < %i < . . . < i m < n, let us examine the 
conditions (l3T8]l - (l3TT2l) closely. It follows by (p31) - (l3T0]l for i = n that A n > 1 and hence 
Aj > 1 for alH = 1, . . . , n for A G X + ; Moreover, the inequalities Aj > 1 for all i guarantee 
the validity of if ^ - fOP]! in general. Set 

An = A n — 1 

and set, for 2 < i < n, 

t = f Ai_i + k - ((q - l)pi + qXi - 1), if i = h,. . . ,i m 
\ Xi-i + k — {{q— I) Pi + qXi), otherwise. 
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Then the conditions (f331) - ([3TT2l hold for A <E X + if and only if (A\, . . . , X n ) G Z'j. By a 
direct computation, one further checks that the condition (|3.8j) is reformulated in terms 
of the Aj's as 

n m n 

(3.14) a = -n + (q - k) £ g*" 1 - £ g^ 1 + ^ - 1)A,. 

j=l j'=l i=l 

Hence the equation (|3.13p can be rewritten as 

® L(u n )f ® L(A) C : - l)p + gA) c ] 



AGA+ 



E # | (Ai,...,A„) GZ" that satisfy <^M) } 



l<il<---<«m<n 

= H ^(i.^-i) 6 -^" 1 '*" 9 ' 

This together with (|3.ip implies Part (1) of the theorem. 

(2) Suppose k = q-l. (Note that Det° = Det 9 " 1 , and we could also prove Part (2) of 
the theorem by arguing using k = 0). The argument here is similar to (1) above, and so 
it will be sketchy. For fixed 1 < i\ < i<i < . . . < i m < n, we set 

A re - 1, if i m < n- 1 
An — 2, if i m = n. 



A„ 

and set, for 2 < i < n, 



Vi-i 



Aj-i + (g- 1) - ((<? - l)Pi + q\ - 1), if i = h, . . . ,i m 
A,j_i + (g - 1) - ((g - + gAj), otherwise. 

Again it can be verified as before that the conditions (|3.9p - (|3.12p hold if and only if 
(Ai, . . . , A„) € Z™ . Then (|3.13j) can be rewritten as 

E [L{awi)c ® L(u m ) c ® L(X)c : L((q - l)p + q\) c ] 

n m n 

£ # {(A 1 ,...,A n )eZ'| | a = -n + ^^- 1 -^^- 1 + ^(^-l)A i } 

l<il<-<i m <n— 1 j=l j'=l i=l 

n 

+ ^ # {(A 1 ,...,A n )GZ- | a =-n + ^^ 1 + (^-l) 

l<ii<-<i m =n i=l 

m n 



i=i »=i 



+~ n ~\ IT" 
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j.—n+- — =- 

t i- 1 



"I - " ^-m j I j • • • ) " ) 

Therefore together with (|3,ip we have proved Part (2) of the theorem. □ 

Remark 3.2. Observe that £*(V)<8> A'(V)®T)et k is naturally a bi-graded GL„(g)-module. 
Theorem 13. 11 (2) can be converted into a formula for the bi-graded multiplicity of St in 
S m (V)®A'(V) as follows: 



,-n+2-=l n-2 n-l 

t 9-1 



flst(5'(F)®A'(F);t,s) 

_ r n (st« n - 1 + i« n_1 ) n™=o 2 ( s + 



rnua-^- 1 ) 

Similarly (and more easily), Theorem I3.1f 1) is converted into the following formula for 
1 < k < q - 2: 

H St (S'(V) A'(V) ® Bet k ;t,s) = r^" 1 "^ • -Hj£& ± g j . 

lli=lV i 1 J 

In this way, we obtain a new proof of |WW1 Theorem C] , which was in turn a generalization 
of the earlier work [Mil IMP| (where q is assumed to be a prime) . 

There is an isomorphism of GL n (g)-modules A n ~ m {V) ^ A m (V)* ® A n (F) and A n (F) ^ 
Det, where denotes the dual module of a GL n (q)-module W. Hence, we have an 
isomorphism of GL n (g)-modules 

(3.15) A m (V)* ^ A n ~ m (V) ® Det" 1 ^ A n ~ m (l/) (g> Det 9 " 2 , < m < n. 

Theorem 13.11 can now be converted into the following form using (|3.15p . 
Corollary 3.3. The graded multiplicity of St in S'(V) ® A m (V)* <g) Det fe is given by 
H St {S'(V) ® A m (V)* ®Det k ;t) 

I (d-t^-^e (r 1 t- q r qn ~ 2 ) 

Y\ n _ (1 - K-i) V ; e n _ m ^ ,i j 

e n „ m (t-\ t-«,..., t-^- 1 )), ifk = l 



t -„+( g +i-fc)ifj 

. nr^a-* 9 *- 1 ) 



3.3. The multiplicity of St in S'(V) <g> A"(F) <g> Det fc . For a partition v = (i/ l5 . . . , v t ) 
with u\ < n, denote by A"(V) the GL n (g)-module 

A"(F) = A^(y)®---® A^CV). 
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Recall e v denotes the elementary symmetric polynomial associated to v. The following is 
a generalization of Theorem 13.1( 1) (which corresponds to the case £ = 1 below). 

Theorem 3.4. Let v = (vi, . . . , vg) be a partition with length £{v) = £ and v\ < n. Let 

k be a positive integer such that k + £ < q — 1. Then the graded multiplicity of St in 
S*(V) <g> A U (V) <g> Det fc is given by 

H St {S'(V) ® A"(F) ® Det fc ; t) = * ^g- e^t" 1 , t~", i"*" -1 ). 

Proof. Fix a € Z + . By arguments similar to Theorem 13. 1\ one can show using Proposi- 
tion [23] and Pieri's formula that, for a > 0, 

dim Hom GLn((?) (Si, 5 a (F) <g> A"(V) ® Det fc ) 

= [i(awi) c ® LK) C ® • ■ • ® L(w, f ) c ® ® I(A) C : L((q - l)p + qX) c ] 

\£X+ 

(3.16) 

= £ ini, 

\ex+ 

where T u x is the set consisting of the sequences ((ai, . . . , a n ) , {i b u \l < u < i>b,l < b < £)) 
satisfying (|3.3p - (|3.5p and the following additional conditions (|3.17p - ([3.19p : 

(3.17) 1 < i{ < ■ ■ ■ < it. <n, l<j<£, 

3 "b 

(3.18) \ + (ai,...,a n ) + ku n + J2J2 £ i b u 6 X+ ' 1 - 3 < 4 

6=1 u=l 

t Vb 

(3.19) A + (ai, ...,(%) + ku n + ^ ^ = (g - l)p + gA. 

6=1 u=l 

Note that (|3.18p will automatically hold if ((ai, . . . , a n ), < u < ^6, 1 < 6 < £)) satis- 
fies (|3.17p and ()3.19p . This is clear once we visualize the weight (g — l)p + qX as a Young 
diagram whose consecutive rows differ by at least (q—1), and removing at most £ boxes in 
each row gives rise to new Young diagrams corresponding to the weights in (|3. 18[) (recall 
here £ < q — 1 by assumption) . 
For 1 < i < n, denote 

d = #{(6, u) | i h u = i, 1 < u < Uf,, 1 < b < £}. 

Hence, regarding (|3.19p as a defining relation for (a\, . . . ,a n ), we see that the set Y v x has 
the same cardinality as the set consisting of the sequences < u < z^, 1 < b < £) 

satisfying (f3TT7D and (^20D - (^22l) below: 

(3.20) (q - l) Pi + (q- 1)A* - fc - c; > 0, 1 < i < n, 

(3.21) (g - l)pi + gAj - q < Aj_i + fc, 2 < i < n, 

(3.22) (g - l)|p| + (g - 1)|A| - nk - \v\ = a. 
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Therefore, the identity (|3.16p can be rewritten as 
dim Hom Gin((?) (St, S a (V) <g> A V (V) ® Det fc ) 
= #{ the tu P les Kl 1 <u<v b ,l<b<£) that satisfy (pTT7|l . (l3T27!j) - ([3T22l )} 

AGX+ 

(3.23) 

# {A G AT+ that satisfy (^20|) - (l332l } . 

l<i{<-<i£<n, 1<J<£ 

Given 1 < < • • • < i 3 v . < n for 1 < j < £, we set A = (Ai, . . . , A n ) for A € X + with 
A« = A n — 1, 

Ai_i = Ai_i + k-((q - l)pi + q\i - Ci), 2 < i < n. 

We claim that (^201) and (^211) hold for A 6 X + if and only if A = (Ai, . . . , A n ) G %\ . 
In fact, (I3.21|) is clearly equivalent to that \ > for 1 < i < n — 1. Also, (I3.20p for 
i = n (which reads that (q — l)A n — k — c n > 0) holds if and only if A n = A n — 1 > 0, 
since 1 < k + c n < k + i < q — 1 by assumption. It is further readily checked that 
A G X + follows from A G Z™. So it remains to see that if (Ai,...,A n ) G Z™ then 
(g — l)pi + (q — l)Aj — k — Ci > for 1 < % < n — 1; this follows from the facts that 
k + Ci<k + £<q — 1 and Aj > A n > 1. 

On the other hand, a direct calculation shows that 

ran n 

- 1)A 4 = ]>> - 1)A< - («" - 1) + Hi*- 1 ~ 1) 

i=l i=l i=l 

n n 

- ^((T 1 - i)(g - l)« + E^" 1 " ^ 

j=l i=l 

It follows that 

(?-l)|p| + (g-l)|A|-nfc-M 

n n 

= J>* - l)Ai + (q n - 1) + £ ~ 

i=l i=l 
n n 



- ]T fctf" 1 - 1) - E^" 1 - ^ - nfc - n 

i=l i=l 

II 

Y^(q l -iyX l + (q n -l) + (-n+l + q + --- + q n - 1 ) 
i=l 

n n n 

i=l i=l i=l 

n n 1 n 

V(g* - l)Ai + (-n) + (g - A;)^- - V g^Q, 
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since Y12=i c-i = v\ + . . . + vi = This together with the identity 

n 

2 qi ~ lci = £ 

1=1 l<&<^,l<fi<^6 

implies that (|3.22p is equivalent to 

n 



(3.24) a = Yltf-l)k + {-n) + (q-k)?— T - £ 

i=l ^ l<b<£A<u<u b 



q n -l t o_ t 
l<6<^l<u<i/ 6 
Summarizing, we can rewrite ()3.23j) as 

dim Hom GLn((?) (St, S a (U) ® A U (V) Det fc ) 

#{(Ai,...,A n ) G that satisfy (13231)} 

l<i{<-<ii.<n, l<j<£ 

= w ica-^') 35^""' , ---'' f " ) 

,-n+( 9 -*;)^ 

= >1 lLC-^ r ' r ' ' > 

Therefore, 

#St(S"00<8> A v (y)®Det fc ;t) 
= ^ (dim Hom GLn(9) (St, 5 a (F) ® A"(V) Det fc )) • t a 

a>0 

/ —1 —q — q n ~ \ 

= nr= 1 (i-^- i ) ev( ' } " 

The theorem is proved. □ 

Remark 3.5. Using a similar argument, we can in principle obtain a (very messy in general) 
formula for the graded multiplicity of St in S'(V) ® A U (V) ® Det fe without the assumption 
that fc + ^ < 5 — 1, generalizing Theorem 13.1( 2). For example, the formula in the case 
u = (1, 1, . . . , 1) is given by 

tfgtOS'CtOaF^BDet*;*) 



c=0 



C( + -q n 1 \c 



n?=i(i-^ 

,-n+(2g-l-fe)a-=l 



c=q— fe 

for 1 < A; < q — 1. 
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By (I3.15p . one has 
(3.25) A" (V)* A n ^ e (V) ® • • • ® A^OO ® Det«- 1_/ 

for any partition with i^i < n. Hence, Theorem 13,41 can be converted into the following 
form and vice versa. 

Corollary 3.6. Let v = (17, . . . , Vg) be a (nonempty) partition with length i(y) = I such 
that v\ < n. For i < k < q - 1, the graded multiplicity of St in S'(V) <g> A V (V)* <g> Det fc 
is given by 

*-n+(ff-*)£r 

H St (S'(V) A»(V)* Det fc ; t) = (1 _^-i } e ^ #> ■ ■ • > i<? "~ )■ 

3.4. The multiplicity of St in S'(V) £g)L(/i) <8>Det fc . Let be the symmetric group of 
d letters. According to the Schur duality, V® d as a GL n {¥) ® S^-module (and hence also 
as a GL n (q) <g> S^-module) is semisimple and multiplicity-free, for 1 < d < p — 1. We now 
compute the multiplicity of St in S'(V) <8>L(/j,) (g>Det fc . Our more restrictive condition on 
/i below ensures that L(fi) appears as a direct summand in V® d for 1 < d < p — 1. 

Theorem 3.7. Fix 1 < fc < q — 1 and 1 < d < p — 1. Lei /i = (/^i, . . . , /i n ) 6e a partition 
of d with £(fx) < n. 

(1) If k + /ii < g — 1, i/ien i/je graded multiplicity of St in i/ie graded GL n (q)-module 
S'(V) <g> L(jS) <g> Det fc is given by 

HstC^OO ® ® Det fc ; t) = _ ^(f 1 ,*-', . . . , t"^" ). 

^ // < < q — 1, then the graded multiplicity of St in the graded GL n (q)-module 
S'(V) (g> L(fi)* <g> Det fc is given by 

H St (S'(V) m* Bet k ;t) = ^-—— Sf ,(t, If,..., t« n ~ ). 

Proof. (1) Suppose k + pL\ < q — 1 and let // be the conjugate of [i. Then E(fjf) = /xi and 
hence A; + £(//') < q — 1. By Theorem 13. 4} we have 

,-n+(g-fc)^ T i 

flst(S"(V) IS A^'(F) ® Det fc ;t) = n _ ^-n V^" 1 .^ ■ ■ ■ )■ 



Since d < p — 1, the GL n (g)-module V® is semisimple and so is its submodule A M (V). 
Hence, we have the following decomposition of GL n (g)-modules: 

(3.26) A*(V)* J2 K^LW^Lb*)® ]T K^Lfr), 

f(7)<n,7</i ^(7)<™,7<A* 

where Ky^i are the Kostka numbers (cf. e.g. |FH| ) . 

We complete the proof of Part (1) by induction on the dominance order of fj,. For \i 
minimal in the sense that there is no partition 7 < fi with £(7) < n, Part (1) reduces to 
Theorem [35 
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Now let fi = (jtii, . . . ,11ft) be a general partition of d with £(/j.) < n. For 7 < fj, with 
^(7) < n, we have 71 < m and + 71 < g — 1. Thus by induction hyperthesis we have 

H St (S'(V) L( 7 ) Det fc ; t) = ^ _ ^ ^(f 1 ,^, . . . , r*"~ ). 

This together with (|3.26p gives us 
ffst(.S"(V)®L(>i)®Det fc ;t) 

=Fst(5 , (y)8>A^'(y)®Det fc ;t) - ^ liC 7V i?st(S'0O ® L( 7 ) ® Det fc ; t) 



£(7)<n,7</^ 

£-n+(g-fc)^zr 



f - v e M /(i- i ,t-«,...,t-9- )- ^ v^r 1 ,^,...,^ ) 

JTi=lA ' ^(7)<",7<M 

r n+(g-fc)^ ^ _ 

where the last equality is due to the symmetric function identity 

e^'(xi,x 2 , ■ ■ ■ ,x n ) = Ky^s 1 (x 1 ,x 2 , . . . ,x n ). 

7hd/(7)<n,7</i 

(2) Suppose /^i < k < q — 1 and let fi' be the conjugate of /i. Then ^(//) = /ii and 
hence < k. By Corollary 13.61 we have 



H St (S'(V) ® A M (F)* ® Det fc ; t) = (t, t\ . . . , f ). 

1 li=l V 1 J J 

On the other hand, by (|3.26|) one has 

7hd,£(7)<n,7</i ■y\-d,£('y)<n,j<fi 

The theorem follows by an argument similar to the proof of Part (1). □ 



4. The composition multiplicity in S'(V) around the Steinberg module 

In this section, we shall determine the graded multiplicity in the symmetric algebra 
S'(V) for a large class of of irreducible modules around the Steinberg module. 

Recall the definition of the Hilbert series of a graded vector space from Section 13.11 
Denote by P(X) the projective cover of the irreducible GL n (g)-module L(X) for A € X r . 
The graded multiplicity of L(X) in the symmetric algebra S'(V) is equal to the Hilbert 
series of the graded space Hornet ( g )(P(A), S'(V)). 
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4.1. A case for any prime p. Recall that q = p r . For A 6 X r , set 
(4.1) X° = (q-l)p + w Q X. 

According to Tsushima [Tsj (which goes back to Lusztig [Lu] for m = 1 and p > 2), we 
have, for 1 < m < n — 1, that 



P«), ifg>2 
P«) St, if g = 2, 



st® A m (y) = 

and hence also, for all 1 < k < q — 1, 

(4.2) St ® A m (^) ® Det fc - ( ^ + c+ ^ , l q> l 

y ' y ' \ P(u° m + ku n ) St ® Det fe , if g = 2. 

Recall the Kronecker symbol 82, q = 1 if q = 2 and (52, 9 = if (/ > 2. For 1 < m < 
n — 1, define 7 = (71, . . . , 7n ) € X r by 7, = (q — l)(n — i) — k — 1 for 1 < i < m and 
7i = (g — l)(n — — k for m + 1 < i < n. 

Theorem 4.1. Suppose 1 < m < n — 1 and 1 < k < q — 1. 

(1) For 1 < k < q — 2, the graded composition multiplicity of L(j) in S'(V) is given by 

n ^ =1 (l-^l) ^ '* '* ^ 

(%) The graded composition multiplicity of L(j) in S'(V) is given by 



n 



r i(1 _Vi) " - ' 



+ e^r 1 ,*-*,.--,*"* ,r* n_l ) )-8 2>q — 



t + 9-1 



rnLiU-^- 1 ) 



Proof. Suppose 1 < A; < — 2; observe that this happens only when q > 2. 
By (f37T%|) and ([12]) we have 

St ® (A m (y) (8) Det fe )* = St ® A n " m (T/) ® Det" 1 ^ = P(w°_ m - (A + l)w„) = P( 7 ). 
This implies that 

Hom GL „ (?) (P( 7 ),5'(y)) 

^Hom GLn((?) (St ® (A m (F) ® Det fc )*, S*(V)) 
^Hom GL „ (3) (St,5*(y) ® A m (V) ® Det fc ). 

Thus, Part (1) of the theorem follows by Theorem 13.1( 4). By a similar argument and 
Theorem 13.1( 2). the second part in the case q > 2 follows. 

Suppose now q = 2. Note that the determinant module Det coincides with the trivial 
module. Using (|4.2p we get 

st ® A m (vy = st ® A n - m (v) = p( 7 ) e st 
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and hence, for a > 0, 

dimHom GLn((?) (P(7),5 a (y)) 

= dimHom GLn(g) (St®A m (F)*,5 a (y))-dimHom GLn((?) (St,S a (y)) 

= dimHom GLn(g) (St,5 a (y) ® A m (F)) -dimHom GLn(g) (St,5 a (y)). 

The theorem for q = 2 now follows from this identity and Theorem 13.1( 2). Note a 
special case of Theorem l3.1( 2) for m = says that the graded multiplicity of the Steinberg 

q n -l 

module St in the symmetric algebra is given byt " 9-1 J|" =1 (l — t q □ 

Remark 4.2. Theorem 14.11 under the additional assumption that q is a prime was first es- 
tablished by Carlisle and Walker |CWl Corollary 1.4] using a completely different method. 
Their formula is equivalent to ours since 



-n+(q— k) 



f""Tir»j q _ 1 

rnLiU-^- 1 ) 



niLia-^- 1 ^ 



j.q+q 2 + ...+q n ~q 1 l ~...-q lm -n 

0<ii<i2<...<im<n— 1 

4.2. A general composition multiplicity formula. Throughout this subsection, we 
assume that p > n, the Coxeter number of GL n (q). 

We denote by br(iV) the Brauer character of a G L n (q)-module N (cf. |Huj ) . For any 
W- invariant element 7 £ Z,[X] W with W = S n , one writes it as a linear combination in 
terms of the formal characters of the simple modules L(X) for A G X r and define its Brauer 
character Br(7) to be the corresponding linear combination of Br(L(A))'s. Denote by 
a set of coset representatives in W of the stabilizer subgroup of [i. Then the orbit 
sum X^creW* eCrfl ^ %->[X] w has the monomial symmetric polynomial m /J (e ei , . . . , e 6n ) as its 
formal character, and its Brauer character will be denoted by Br(m«). Let <j> denote the 
Brauer character of St. The following is essentially a result of Ballard [Ba, Proposition 7.2] 
in the case of GL n (q). 

Lemma 4.3. Assume that p > n. If fx G X r satisfies \i\ — fj, n < p — 1, then the Brauer 
character of the projective GL n (q) -module P(n°) is equal to (j)Br(rnu)- In particular, 

dimP( M °) = dim St • \W»\ = fl^^-l) 1j • • • ' 1} - 

Remark 4.4. For q = p r with r > 2, the bound in [Bat Proposition 7.2] can be stated as 
Ml — Mn < P~ 1 as above, while for q = p, Ballard imposed the more restrictive assumption 
that hi — fi n < (p — l)/2 (because of using \B&\ Lemma 7.3]). Chastkofsky remarked in 
his math review on |Baj that the bound in Ballard's paper can always be improved to 
Mi — Mn < P — 1, using his work |Chj (also see Jantzen [Jl] for closely related results). 

Recall that (cf. |FH] ) elementary symmetric functions can be expressed in terms of 
monomial symmetric functions as follows: 

(4.3) e u = a vp m^ 

H<v' 



THE GL n (q)-MODULE STRUCTURE OF THE SYMMETRIC ALGEBRA 17 

where a Ufl are nonnegative integers and a vv i = 1. This can be seen by expressing e v in 
terms of Schur functions s\ and then s\ in terms of m M . 

Proposition 4.5. Suppose p > n and < k < q — 2. Let v he a partition such that v\ < n 
and u[ — v' n <p — l. Then the GL n (q) -module St (g> A"(V) £3 Det fc can &e decomposed as 

St A"(F) ® Det fc P(r° + A:w n )® a -, 

T<!/,£(r)<n 

where defined in J^.gp . 

Proof. As the module St <8> A^V) ® Det fc is known to be projective, it suffices to check 
the isomorphism in the proposition on the Brauer character level. We can further assume 
k = 0, as the general case is then obtained easily by tensoring by Det fc . By (|4.3h . the 
Brauer character of St <8> A U (V) can be written as 

Br(St ® A"(V)) = 4>Bt(A u (V)) = ^ a UT cbBr(m T ). 

T<v',i(r)<n 

Observe that if r < v' then t\ — r n < 1*1 — v' n < p — 1. It follows by Lemma 14,31 that 
0Br(m r ) is the Brauer character of the projective indecomposable module P(t°). So we 
have established the desired identity of Brauer characters. □ 

The projective GL n (g)-module P(A) for A € X r has both head and socle isomorphic 
to L(A), and therefore P(A)* = P(-w A). Then thanks to the fact that St* £S St, 
Proposition 14.51 can be converted into the following. 

Corollary 4.6. Suppose p > n and < k < q — 2. Let v he a partition such that v\<n 
and u[ — v' n < p — 1. Then the GL n (q) -module St (g> A U (V)* ® Det fc can 6e decomposed as 

St ® A V (F)* (8) Det fc ^ P((g- l)p-r + fcw„) ffia ^. 

r<i/'^(r)<n 

Below is a main result of this section. 

Theorem 4.7. Suppose p > n and < k < q — 2. Let p be a partition with £(p) < n and 
Pi ~ Pn < P~ 1- 

(1) If Hi < k, then the graded composition multiplicity of L{{q — l)p — p + ku n ) in 
S'(V) is 

n^iCi-^- 1 ) " v '"' 

^ If jjLi + k < q—1, then the graded composition multiplicity of L((q—l)p + wop + ku n ) 
in S*(V) is 



r „ +(fc+1) £__l 



11^(1 -f- 1 ) 



- m M (t,t",...,t 9 ). 
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Proof. (1) Suppose p\ < k. We shall prove by induction on dominance order of p the 
equivalent claim that the Hilbert series of Hom Gin ( g )(P((g — \)p — p + ku n ),S'(V)) is 
given by 

t _n+(k+l)£r 



For /x minimal in the sense that it has no partition r < p with t(r) < n, by (|4.3|) we 
have 

e M , (r 1 , t"«, . . . , r*"" 1 ) = m^t- 1 ,^, . . . , r* n_1 ) 

and moreover by Corollary 14.61 we have 

P{(q -l)p-p + kco n ) ^ St ® A^'OO* (8) Det fc . 

Hence 

Hom Gin(g) (P((g -l)p-n + ku; n ), S*(V)) 

^Hom GLn(?) (St <g> A"' (F)* ® Det fc , 

^Hom GLn(?) (St, S"(F) A^'(y) Det 9 " 1 ^). 

The claim for such a minimal weight p follows by Theorem 13,41 since 1 < q — 1 — k < q — 1 
and /ii + (q — 1 — A;) < q — 1 by the assumption p\ < k. 

If r is a partition satisfying r < p, then t\ < p\ < k and t\— T n < p\—p n < p—1. Hence 
by inductive assumption the Hilbert series of B.om GLn ^(P((q — l)p — r + ku) n ), S'(V)) 
for r < p is given by 



n+(fc+ l)£^_i 

u / — 1 n —n n — 1 \ 

By Corollary 14.61 and Theorem 13.41 the Hilbert series of Hom GLn ^(P((q — l)p — p + 
ku) n ),S'(V)) has the form 



t -™+(fc+i)Vr 



rcua-^-o 



— ( e^{t~\t-^ . . .,*-«** - a^TJvCr 1 ,^', . . . ,t- 9 " -1 )) 



n+(fe+1) ^ f _i 

f ^ / 1 ^, r"* 71 — 1 . 



Here we have used the identity that e^/ = ^t<^ a ^T m T an d oy^ = 1. Therefore the first 
part of theorem is proved. 

The second part of the theorem follows from a similar argument together using Propo- 
sition HJ)] and Corollary 13.61 □ 

Remark 4.8. There is a duality formulated in |CWl Proposition 2.12] between the graded 
composition multiplicity of L(p) and that of L(p)* in general. The two parts of Theo- 
rem 14.71 fit well with such a duality. 
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4.3. The coinvariant algebra. According to a classical theorem of Dickson |Dij . the 
algebra of GL n (^-invariants S'(V) GLn ^ is a polynomial algebra in n generators, and its 
Hilbert series is given by 

(4.4) =— ^ -. 

Consider the following quotient algebra 

S'(V) GLn{q) :=S-(V)/I% 

where II. denotes the ideal of S'(V) generated by homogeneous elements of positive 
degree in S*{V) GLn ^ q \ The graded algebra S*(y) GLn ^ is called the coinvariant algebra 
for GL n (q). We recall the following basic results of Mitchell. 

Lemma 4.9. \M.i\ Proposition 1.3, Theorem 1.4] As GL n {q) -modules, 

(1) S'(V) has the same composition series as S'(V) GLn ^ ® S'(V)cL n (q)! 

(2) S'(V)Gi n ( q } has the same composition series as the regular representation ¥GL n (q). 

Mitchell further pointed out that S m (V)GL n (q) 1S n °t isomorphic to ¥GL n (q) since 
S'(V)GL n (q) nas t ne trivial module (in degree zero) as a direct summand. 

Thanks to Lemma [4.91 Theorem 14.71 admits the following reformulation in terms of the 
coinvariant algebra. 

Theorem 4.10. Suppose p > n and < k < q — 2. Let p be a partition with £(fi) < n 
and fix — fj, n < p — 1. 

(1) If jJL\ < k, then the graded composition multiplicity of L((q — l)p — /i + kuj n ) in the 
coinvariant algebra S*(V)c<L n (q) * s 



m fl (t~\t- q ,...,t- q 



n-l , 



niiia-^ 1 ) 

(2) If fii + k < q—l, then the graded composition multiplicity of L((q—l)p + wofi + kuj n ) 
in the coinvariant algebra S'{V)GL n (q) is 

n _ -1 

r^+^n^i -**"-*') m (t t q ^ 
n^(i-^) )• 

Observe that the limit as t i— > 1 of either formula in the above theorem is equal to 

= dim St ■ m^(l, 1, . . . , 1) 
= dim St • \W% 

which is the dimension of the corresponding projective cover by Lemma 14.31 This is 
consistent with Lemma 14.9} since the composition multiplicity of a simple module in the 
regular representation of a finite group is always equal to the dimension of its projective 
cover. 
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4.4. Some open problems. Theorem 14.11 and Theorem 14.71 have provided partial an- 
swers to the problem of finding the graded composition multiplicity of an irreducible 
GL n (<7)-module in the symmetric algebra S'(V). They are obtained by converting the 
computations of the Steinberg module multiplicity in S'(V) (g) A"(V) in Section [3] and the 
results of Ballard and Tsushima. 

Question 4.11. How to decompose St <8> iV into a direct sum of PIMs for a reasonable 
GL n (q)-module N? Can we relax the restriction on pi 

Suitable generalizations of results of Ballard and Tsushima in answer to the above 
question would allow one to expand the range of applicability of the approach developed 
in this paper. The methods developed in this paper seem likely to apply to the following. 

Question 4.12. Find the composition multiplicity of the Steinberg module (or the simple 
modules around it) in the symmetric algebra of the natural module for other classical 
finite groups of Lie type. 

The GL n (g)-module S*(V) is not semisimple, and it makes sense to ask the following. 

Question 4.13. What is the graded multiplicity of a simple GL n (g)-module L{fj) in the 
socle of S\V)1 

Dickson's classical theorem [Dij (see (j4.4j) ) provides a first beautiful answer in case 
when L(/j,) is the trivial module. Several generalizations have been obtained in [Muil IMi} 
\MP\ IKMj . culminating in our previous work [WWj which settled this socle mutiplicity 
question for the simple modules of the form A m (V) <g> Det fc for arbitrary prime powers 
q = p r , 1 < m < n and < k < q — 2. The answer in loc. cit. fit into the following form, 
which we ask if it holds for a wider class of L{(jl): 

Let fx = (fj,i, . . . , n n ) be a partition of d with 1 < d < p — 1 and < k < q — 2 — Is 
the multiplicity of the simple module L{p) ® Det fe in the socle of S'(V) given by 



, • s u tt.t* . . . ,t H ) 

nr=o(i-^) 
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